Skip to content

[Frontend] Fix Flaky MCP Streaming Test#32153

Merged
DarkLight1337 merged 1 commit intovllm-project:mainfrom
daniel-salib:fix-flaky-mcp-test
Jan 12, 2026
Merged

[Frontend] Fix Flaky MCP Streaming Test#32153
DarkLight1337 merged 1 commit intovllm-project:mainfrom
daniel-salib:fix-flaky-mcp-test

Conversation

@daniel-salib
Copy link
Copy Markdown
Contributor

@daniel-salib daniel-salib commented Jan 12, 2026

Purpose

test_mcp_code_interpreter_streaming is occasionally failing due to inconsistent behavior of whether it decides to trigger a tool call. Since the math question is too simple, a tool call isn't always triggered. A more complicated math problem like "123 * 456" consistently triggers the MCP tool call

Test Plan

pytest entrypoints/openai/responses/test_harmony.py::test_mcp_code_interpreter_streaming

Test Result

Consistently passes unit test


Note

Cursor Bugbot is generating a summary for commit 3d2756b. Configure here.

Signed-off-by: Daniel Salib <danielsalib@meta.com>
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request addresses a flaky test, test_mcp_code_interpreter_streaming, by replacing a simple math problem with a more complex one to ensure the MCP tool call is consistently triggered. The change is straightforward, well-explained, and appears to be an effective fix for the test's flakiness. I find no issues with this modification.

@chaunceyjiang chaunceyjiang self-assigned this Jan 12, 2026
@chaunceyjiang chaunceyjiang added the ready ONLY add when PR is ready to merge/full CI is needed label Jan 12, 2026
Copy link
Copy Markdown
Member

@DarkLight1337 DarkLight1337 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Passed, let's merge to unblock CI.

@DarkLight1337 DarkLight1337 merged commit d7b2e57 into vllm-project:main Jan 12, 2026
25 checks passed
TomerBN-Nvidia pushed a commit to TomerBN-Nvidia/vllm that referenced this pull request Jan 13, 2026
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
sammysun0711 pushed a commit to sammysun0711/vllm that referenced this pull request Jan 16, 2026
Signed-off-by: Daniel Salib <danielsalib@meta.com>
akh64bit pushed a commit to akh64bit/vllm that referenced this pull request Jan 16, 2026
Signed-off-by: Daniel Salib <danielsalib@meta.com>
dsuhinin pushed a commit to dsuhinin/vllm that referenced this pull request Jan 21, 2026
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
ItzDEXX pushed a commit to ItzDEXX/vllm that referenced this pull request Feb 19, 2026
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants